On MCMC sampling in hierarchical longitudinal models
نویسندگان
چکیده
Markov chain Monte Carlo MCMC algorithms have revolutionized Bayesian practice In their simplest form i e when parameters are updated one at a time they are however often slow to converge when applied to high dimensional statistical models A remedy for this problem is to block the parameters into groups which are then updated simultaneously using either a Gibbs or Metropolis Hastings step In this paper we construct several partially and fully blocked MCMC algorithms for minimizing the autocorrelation in MCMC samples arising from important classes of longitudinal data models We exploit an identity used by Chib in the context of Bayes factor computation to show how the parameters in a general linear mixed model may be updated in a single block improving convergence and producing essentially independent draws from the posterior of the parameters of interest We also investigate the value of blocking in non Gaussian mixed models as well as in a class of binary response data longitudinal models We illustrate the approaches in detail with three real data examples
منابع مشابه
Comparing MCMC and INLA for disease mapping with Bayesian hierarchical models
Introduction Bayesian hierarchical models with random effects are one of the most widely used methods in modern disease mapping, as a superior alternative to standardized ratios. These models are traditionally fitted through Markov Chain Monte Carlo sampling (MCMC). Due to the nature of the hierarchical models and random effects, the convergence of MCMC is very slow and unpredictable. Recently,...
متن کاملEmpirical estimates for various correlations in longitudinal-dynamic heteroscedastic hierarchical normal models
In this paper, we first define longitudinal-dynamic heteroscedastic hierarchical normal models. These models can be used to fit longitudinal data in which the dependency structure is constructed through a dynamic model rather than observations. We discuss different methods for estimating the hyper-parameters. Then the corresponding estimates for the hyper-parameter that causes the association...
متن کاملA limited‐memory acceleration strategy for MCMC sampling in hierarchical Bayesian calibration of hydrological models
Kuczera, George; Kavetski, Dmitri; Renard, Benjamin; Thyer, Mark Andrew A limited memory acceleration strategy for MCMC sampling in hierarchical Bayesian calibration of hydrological models Water Resources Research, 2010; 46, W07602:1-6 Copyright 2010 by the American Geophysical Union The electronic version of this article is the complete one and can be found online at: http://onlinelibrary.wile...
متن کاملFitting Bayesian hierarchical multinomial logit models in PROC MCMC
The paper illustrates how to use the MCMC procedure to fit a hierarchical, multinomial logit model for a nominal response variable with correlated responses in a Bayesian framework. In particular, the paper illustrates how to perform three important parts of Bayesian model fitting. First, to make sure appropriate prior distributions are selected, the paper shows how to simulate draws directly f...
متن کاملA Split-Merge MCMC Algorithm for the Hierarchical Dirichlet Process
Abstract The hierarchical Dirichlet process (HDP) has become an important Bayesian nonparametric model for grouped data, such as document collections. The HDP is used to construct a flexible mixed-membership model where the number of components is determined by the data. As for most Bayesian nonparametric models, exact posterior inference is intractable—practitioners use Markov chain Monte Carl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Statistics and Computing
دوره 9 شماره
صفحات -
تاریخ انتشار 1999